A scheduling mechanism based on Service Level Objective (SLO) in multi-tenant cluster, including a preference scheduling algorithm and a resource preemption algorithm, was proposed to solve the problem of the inability to guarantee the SLOs of jobs in multi-tenant clusters. The preference scheduling algorithm considered the users who overused resources above their quota and the users who did not, then assigned a higher priority to the jobs of the latter users, under this condition, the job with highest priority was preferentially allocated resources. When the resources was limited, the resource preemption algorithm preempted the resource for the jobs whose urgency was above the threshold, and chose the jobs with the lowest urgency in the corresponding range of the running jobs according to the resource usages of tenants.The experimental results show that, compared with the current multi-tenant scheduler named Capacity Scheduler, the proposed mechanism can significantly improve the deadline guarantee rate of jobs and SLO with guaranteeing the job execution efficiency and the equity among tenants at the same time.